Deep object recognition models have been very successful over benchmark datasets such as ImageNet. How accurate and robust are they to distribution shifts arising from natural and synthetic variations in datasets? Prior research on this problem has primarily focused on ImageNet variations (e.g., ImageNetV2, ImageNet-A). To avoid potential inherited biases in these studies, we take a different approach. Specifically, we reanalyze the ObjectNet dataset recently proposed by Barbu et al. containing objects in daily life situations. They showed a dramatic performance drop of the state of the art object recognition models on this dataset. Due to the importance and implications of their results regarding the generalization ability of deep models, we take a second look at their analysis. We find that applying deep models to the isolated objects, rather than the entire scene as is done in the original paper, results in around 20-30% performance improvement. Relative to the numbers reported in Barbu et al., around 10-15% of the performance loss is recovered, without any test time data augmentation. Despite this gain, however, we conclude that deep models still suffer drastically on the ObjectNet dataset. We also investigate the robustness of models against synthetic image perturbations such as geometric transformations (e.g., scale, rotation, translation), natural image distortions (e.g., impulse noise, blur) as well as adversarial attacks (e.g., FGSM and PGD-5). Our results indicate that limiting the object area as much as possible (i.e., from the entire image to the bounding box to the segmentation mask) leads to consistent improvement in accuracy and robustness.

Over the past year, business leaders worldwide have been sensing that confidence is low – but where's the data to support that? The 2019 Worldcom Confidence Index fills that void with hard data gathered using a revolutionary methodology powered by artificial intelligence (AI). Last year, we predicted that AI would be the big issue of 2019, and we were right. The 2019 Worldcom Confidence Index is just one example of how AI has fundamentally altered our operating concept across a range of industries – from healthcare to manufacturing and now to survey methodology. This forward-thinking approach to gathering and analyzing data is emblematic of the work Worldcom Public Relations Group does and is one of the reasons we're proud to be a member of this global PR network.